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Section 23 

Donsker Invariance Principle. 



In this section we show how the Brownian motion Wt arises in a classical central hmit theorem on the space of 
continuous functions on M+. When working with continuous processes defined on M_|_, such as the Brownian 
motion, the metric || • ||oo on C(K+) is too strong. A more appropriate metric d can be defined by 

dM,9)= sup \m-g{t)\ and = ^ ^"^'f 

It is obvious that d{fj, /) if and only if dn{.fj,f) for all n > 1, i.e. d metrizes uniform convergence 
on compacts. (C(M_|_), d) is also a complete separable space, since any sequence is Cauchy in d if and only if it 
is Cauchy for each When proving uniform tightness of laws on (C(]R+), d), we will need a characterization 
of compacts via the Arzela-Ascoli theorem, which in this case can be formulated as follows. For a function 
X e (7[0, T], its modulus of continuity is defined by 

rn^{x,S) = sup||xa - Xbl : \a-b\<6,a,bG [0,T]|. 

Theorem 55 (Arzela-Ascoli) A set K is compact in (C(M_|_), d) if and only if K is closed, uniformly hounded 
and equicontinuous on each interval [0, n] . In other words, 

sup |a;o| < oo and lim sup ■m7'{x,S) = for all T > 0. 

Here is the main result about the uniform tightness of laws on (C(]R+),(i), which is simply a translation of 

the Arzela-Ascoli theorem into probabilistic language. 

Theorem 56 The sequence of laws (Pn)„>i on (C(M+), d) is uniformly tight if and only if 

lim supP„(|a;o| > A) = (23.0.1) 

and 

limsupP„(m^(a;,(5) >s) = (23.0.2) 

SIO n>l 

for any T > and any £ > 0. 

Proof. . For any 7 > 0, there exists a compact K such that Fn{K) > 1 — 7 for all n > 1. By the 
Arzela-Ascoli theorem, |a;o| < A for some A > and for all x G K and, therefore, 

supP„(|a;o| > A) < supP„(i^'=) < 7. 

n n 

Also, by equicontinuity, for any e > there exists > such that for S < 60 and for all x G K we have 
m'^{x,6) < e. Therefore, 

swpVn{m^{x,6) >£)< supP„(ii:'=) < 7. 

n n 
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. Given 7 > 0, find At > such that 



supP„(|a;o| > At) < ^ 



2T+1- 

For each > 1, find 6k > such that 

7 



supP„(m'^(x,^fe) > < 



2T+fe+l ■ 

Define a set ^ 

At = |a; : |a;o| < At, »Ti^(a;, ^fc) < - for all fc > l|. 

Then for all n > 1, 

P„(At) > 1 - - 2T+fe+i = ^ ~ 

k 

By the Arzela-Ascoli theorem, the set A = nT>i is compact on (C(M+), d) and for all n > 1, 

P„(A)> 1-^^ = 1-7. 

T>1 

This proves that the sequence (P„) is uniformly tight. 

□ 

Of course, for the uniform tightness on (C[0, 1], |1 • |lco) we only need the second condition (23.0.2) for T = 1. 
Also, it will be convenient to slightly relax (23.0.2) and replace it with 

lim limsupP„(m^(a;,(5) > e) = 0. (23.0.3) 

Indeed, given 7 > 0, find So, no such that for 5 < 60 and n > no, 

¥n{m^{x,S)> e) <j. 
For each n < no we can find Sn such that for S < 5n, 

Fn{m^{x,S) > e) < 7 
because m^{x,S) ^ as 5 ^ for all a; e C(M+). Therefore, 

if 5 < min((5o, ^i, . • . , Sn^) then P„(rn^(a;, 5) > e) < 7 

for all n > 1. 

Donsker invariance principle. Let us now give a classical example of convergence on (C(M+),d) to 
the Brownian motion Wt- Consider a sequence {Xi)i>i of i.i.d. random variables such that EXi = and 
0-2 = EXf < 00. Let us consider a continuous partial sum process on [0, 00) defined by 

Wr = ^ E X, + int-lnt\)^^^, 

where \nt\ is the integer part of nt, \nt\ <nt< \nt\ + 1. Since the last term in W" is of order n~^/^, for 
simplicity of notations, we will simply write 

and treat as an integer. By the central limit theorem, 

-L V X, = Vi^^ V AA(o, f). 
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Given t < s,we can represent 



= W" + 



* ' \/na 

nt<i<ns 

and since and — W" are independent, it should be obvious that the f.d. distributions of W" converge 
to the f.d. distributions of the Brownian motion Wi. By Lemma 45, this identifies Wt as the unique possible 
limit of VF" and, if we can show that the sequence of laws (£(W"))„>i is uniformly tight on (C[0, cxd), d). 
Lemma 36 in Section 18 will imply that W" — > Wt weakly. Since Wq = 0, we only need to show equicontinuity 
(23.0.3). Let us write the modulus of continuity as 



m^(W",5)= sup 

\t-s\<5,t,se[0,T] 



ns<i<nt 



< max 

0<fe<nT,0<j<n(5 



E 

k<i<k+j 



If instead of maximizing over all < fc < nT, we maximize over k = InS for < I < m — I, m := T/6, 
i.e. in increments of nS, then it is easy to check that the maximum will decrease by at most a factor of 3, 
because the second maximum over < j < nS is taken over intervals of the same size nS. As a consequence, 
if m^(W", S) > s then one of the events 



\ max 

Lo<j<ni5 



1 



/na 



E 



> 



ln5<i<lnS+j 

must occur for some < Z < m — 1. Since the number of these events is m = T/6. 

F(m^(W",S) >e) < mPf max V X» 

\ J \0<i<n5 ^fnu ^ 



0<i<j 



> 



(23.0.4) 



Kolmogorov's inequality. Theorem 11 in Section 6, implies that if Sn = Xi + h X„ and 



then 



max F{\Sn - Sj\> a) <p<l 

0<j<n 



P( max \Sj\ > 2a) < ^P(|5„| > a). 



If we take a = e^na then, by Chebyshev's inequality. 



j<i<nS 



and, therefore, if 3Q6e ^ < 1, 



( max I y Xi > l-e^/na) < (l - 36fe-2) Vfl V > ^Vna). 
\0<j<nS\ ^ — ' 3 / VI ^-^ 6 / 



0<i<j 



0<i<n5 



Finally, using (23.0.4) and the central limit theorem, 

limsupP(m'^(W4",^) > £) < m(l - 36fe-2)"MimsupP(| ^ X, 

= m(l-36&"2)"'2AA(0,l)(^^ 
< 2T5-i(l-36fe-2)"^exp( 

as ^ ^ 0. This proves that 

limlimsupP(m'^(VF",(5) > e) = 0, 
for all T > and e > and, thus, Wt weakly in (C[0, oo),d). 



0<i<nS 

e 
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